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Abstract 

Background: Although physical inactivity has been linked with numerous chronic health conditions and overall 
mortality, the majority of English adults report doing insufficient physical activity. To increase population physical 
activity levels, researchers have called for more community-level interventions. To evaluate these complex public 
health interventions, innovative study designs are required. This study protocol describes Devon Active Villages, a 
community-level intervention providing physical activity opportunities to 128 rural villages in southwest England, 
and the methods used to evaluate its effectiveness in increasing physical activity levels. 

Methods/Design: A stepped wedge cluster randomised trial will be used to evaluate whether Devon Active Villages 
leads to increased physical activity levels in rural communities. Community engagement will help tailor activity 
programmes for each village; communities will then be supported for a further twelve months. The intervention 
will be delivered over four periods, each lasting twelve weeks. Data collection consists of a postal survey of a 
random sample of adults aged 18 years and over, at baseline and after each of the four intervention periods. The 
questionnaire includes questions on participant demographics, physical activity behaviour, local environment 
characteristics, awareness of local activity programmes, and psychosocial factors. Based on detecting an increase in 
the proportion of people who meet physical activity guidelines (from 25% to 30%), at least ten respondents are 
needed from each of the 1 28 villages at each stage (80% power at the 5% level of significance). Anticipating a 20% 
response rate, 6,400 questionnaires will be sent out at each stage (i.e., 50 surveys to each village). Using data from 
all five periods, a comparison of study outcomes between intervention and control arms will be performed, 
allowing for time period (as a fixed effect) and the random effect induced by correlation of outcomes (clustering) 
within villages. 

Discussion: This paper describes the use of a stepped wedge cluster randomised trial to evaluate a complex, 
community-level physical activity intervention in an under-studied population of adults in rural communities in 
southwest England. The study addresses gaps in the current literature by providing new insights into physical 
activity levels in this population. 

Trial Registration Number: Current Controlled Trials ISRCTN37321 160 
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Background 

In developed and many developing countries physical in- 
activity is one of the most important public health pro- 
blems of the 21 st century [1], There is strong evidence 
linking physical inactivity with various chronic condi- 
tions, such as coronary heart disease, stroke, type 2 dia- 
betes, cancer, obesity and mental health problems [1-3], 
and physical inactivity has been identified as a leading 
risk factor for mortality, estimated to cause 6% of deaths 
globally [4]. In contrast, the numerous benefits of a 
physically active lifestyle have been well documented [3]. 
Despite the preceding evidence, in England only 29% of 
women and 39% of men report doing sufficient physical 
activity to meet the minimum recommended guidelines 
of 150 minutes of moderate intensity physical activity 
per week or 75 minutes of vigorous intensity physical ac- 
tivity per week [5]. This level of physical inactivity is 
estimated to cost the United Kingdom National Health 
Service £0.9 billion per year [6]. 

Substantial health benefits can be achieved through 
relatively modest changes in activity behaviour among 
large segments of the population [7], and therefore phys- 
ical activity interventions are now considered to be as 
important to population health as other high profile 
interventions, such as those lowering tobacco use or re- 
ducing blood pressure [2]. Although the health benefits 
of physical activity are now well-established, little is 
known about the effectiveness of interventions designed 
to improve population physical activity [8]. The majority 
of physical activity interventions have been delivered at 
the level of the individual, aimed at changing personal 
behaviour [9]. To change population prevalence, inter- 
ventions need to be effective, but they also need to reach 
large numbers of people. Although some individual-level 
interventions are effective, their reach is limited when 
compared with community-level interventions. It is 
community-level interventions that have the potential to 
produce long-lasting benefits for the whole community, 
but evidence as to which type of community-wide inter- 
ventions are most effective is currently weak [10]. 

A recent review of research examining the effective- 
ness of community-level interventions to promote phys- 
ical activity reported that many studies used weak 
evaluation designs, such as uncontrolled, pre-post eva- 
luations, and could not attribute any observed changes 
to the intervention [10]. One example of a community- 
level intervention evaluation that did include control 
communities— but was non-randomised— was the 'Cyc- 
ling Demonstration Towns' programme in England [11], 
in which the intervention involved town-wide media 
campaigns, personalised travel planning, cycle training, 
repair services, and cycling infrastructure improvements. 
A controlled, repeated cross-sectional study examined 
the effect of the intervention in six towns between 2005 



and 2008 using telephone surveys of quota samples of 
local residents [11]. The average annual percentage in- 
crease in the number of cyclists on the road was 4%. Net 
increases were also found in the proportions of residents 
who reported cycling for at least 30 minutes on 12 or 
more days per month (0.97% or 1.65%, depending on the 
choice of control areas) [11]. 

Reviews of physical activity correlates suggest that a 
combination of personal, social and environmental fac- 
tors are associated with physical activity prevalence [12], 
but there are very few evaluations of the effects of 
changes to either social or built environments, and stud- 
ies of the built environment are almost exclusively 
restricted to urban environments [10,13]. Both urban 
and rural dwellings report similarly low levels of physical 
activity in adults: on average, 9.5 days per month (95% 
CI: 9.3-9.6) of moderate-to-vigorous intensity physical 
activity for at least 30 minutes [5]. Although 20% of the 
population live in non- urban dwellings [5], rural popula- 
tions are generally understudied [13,14]. Additionally, 
access to recreational facilities and other environmental 
supports for physical activity (e.g., neighbourhood 'walk- 
ability! convenient access to destinations, and perceived 
safety) have been shown to be related to physical activity 
participation [15], with people in rural areas being more 
likely to report lack of facilities as a barrier to physical 
activity [16]. 

Randomised controlled trials are considered the most 
powerful tool in research design for evaluating interven- 
tions, due to their rigorous study design and strict ran- 
domisation procedures [17]. Traditional randomised 
controlled trials, where individual participants are ran- 
domised, are not always reproducible in the real world 
and tend to focus on individuals rather than communi- 
ties, raising doubts about whether a subsequent scaling 
up of individual interventions to larger populations 
would lead to changes in population prevalence [18]. It 
has been suggested that when evaluating interventions 
that are by necessity delivered to groups rather than 
individuals, cluster randomised trials, which randomise 
groups (e.g., communities, villages, towns) and measure 
outcomes on individual participants within those groups, 
are more appropriate [9,19]. 

Cluster randomised trials commonly use a parallel 
group design, in which the clusters are randomised to ei- 
ther the intervention or control arm of the study. For 
practical reasons it is often not possible to deliver an 
intervention to many clusters at the same time. In 
addition, it is often regarded as unethical to withhold an 
intervention from a proportion of participants if it is 
believed that the intervention will do more good than 
harm. In these circumstances, stepped wedge trial 
designs [20], where the intervention is delivered sequen- 
tially to all trial clusters over a number of time periods, 
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is an alternative to the traditional parallel groups design. 
In a stepped wedge design, clusters effectively cross over 
from the control to the intervention group. The stage at 
which the clusters cross over is randomised. Outcomes 
are measured on the study participants in all clusters at 
every time period so that each cluster provides data 
points in both the control and intervention conditions 
[21]. Examples of stepped wedge investigations include 
the efficacy of Hepatitis B vaccinations [22], the effect of 
housing improvements on respiratory health symptoms 
[23], and different tuberculosis treatments on number of 
disease episodes [24]. 

The objective of this paper is to describe the protocol 
of a stepped wedge cluster randomised trial for evaluat- 
ing the effectiveness of a community-level intervention 
to increase physical activity in rural villages in southwest 
England. The intervention will identify community needs 
and then provide resources and support to initiate local 
activity programmes, ultimately aiming for the activities 
to become self-sustaining over time. The intervention is 
expected to improve physical activity participation after 
each village receives the intervention. It is also antici- 
pated that changes will be observed in levels of social 
support, physical activity intentions, awareness and use 
of local facilities, and perceived village supportiveness of 
physical activity. 

Methods/Design 

Study design 

The Devon Active Villages Evaluation (DAVE) protocol 
is based on a stepped wedge cluster randomised con- 
trolled trial design (Figure 1). During the DAVE study, 
the intervention will be rolled out sequentially to 128 
rural villages (clusters) over four time periods. The 
evaluation will consist of data collection at five fixed 
time points (baseline and following each of the four 



intervention periods). The period in which the villages 
first receive the intervention will be randomly assigned, 
stratified by the seven regions of the county of Devon 
(see below). The intervention will be fully implemented 
by the end of the trial, with all 128 villages receiving the 
intervention: 22 first receiving the intervention at period 
2, 36 at period 3, 35 at period 4, and 35 at period 5. 

Setting and participants 

Devon Active Villages is a community-level intervention 
coordinated by Active Devon, the Devon county partner- 
ship for sport and physical activity. Active Devon 
received circa £950,000 funding for the Devon Active 
Villages intervention from Sport England (the govern- 
ment body for sports promotion) and Devon County 
Council as part of Sport England's 'Rural Communities' 
funding scheme. The Devon Active Villages Evaluation 
(DAVE) research study is being conducted by the Uni- 
versity of Exeter in close liaison with Active Devon. 

Devon is characterised by ten distinct regions, of 
which three are urban (Exeter, Plymouth and Torbay), 
and seven are rural (East Devon, Mid Devon, North 
Devon, South Hams, Teignbridge, Torridge and West 
Devon). All intervention villages are located in one of 
the seven rural regions. The Devon Active Villages inter- 
vention will provide activities for all age groups. 

In the initial planning of the intervention, Active 
Devon identified 155 rural villages to receive the Devon 
Active Villages intervention across the course of three 
years. Prior to the intervention, Active Devon ran a pilot 
intervention with 15 villages, the outcome of which was 
used to inform the main intervention protocol. 

Recruitment and randomisation 

Of the remaining 140 villages that were not part of the 
pilot, twelve could not be included in the evaluation due 



Cluster 



C1 
C2 
C3 
C4 



T1 



T2 



T3 



T4 



T5 



Time (5 stages) 



Control unit = villages without the Devon Active Villages programme 
Intervention unit = villages with the Devon Active Villages programme 



Figure 1 Design of the DAVE study. One cluster (C1, C2, C3 or C4) represents one group of intervention villages. Each time period (T1, T2, T3, 
T4, or T5) represents a data collection point. Each unit (control or intervention) represents one time period of one cluster. 
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to engagement with local community members before 
baseline data collection had commenced. Thus, the 
remaining 128 villages (clusters) were recruited and ran- 
domised to first receive the intervention in one of the 
four periods, stratified by region. Villages with popula- 
tions of 500-2000 people formed the sampling frame for 
the intervention. These population boundaries were set 
so that villages were large enough to have local facilities 
suitable for physical activity, but limited in the amount 
of activity opportunities they offered. 

Data collection for the evaluation study will focus on 
adults aged 18 years and over. The study will use a 
repeated cross-sectional design, in which a random sam- 
ple of people within each cluster will be surveyed at each 
stage. A complete list of all households in each of the 
128 study villages will be obtained using the Postcode 
Address File (Address List Utility, Arc en Ciel, Version 
3.1 PAF Quarter 1, 2011). The order in which house- 
holds are approached to participate in the survey at each 
stage will be randomly generated. One adult per house- 
hold will be randomly selected. If there are multiple eli- 
gible adults in the household, an invitation to complete 
the survey will be given to the adult who has most re- 
cently had a birthday. 

Intervention 

The primary objective of the Devon Active Villages 
intervention is to improve participation in physical activ- 
ity by offering people of all ages increased opportunities 
to experience the enjoyment of sport and physical activ- 
ity. The intervention will be implemented and coordi- 
nated locally by Local Delivery Partners. Local Delivery 
Partners include District Authority Sports Development 
Teams and community-based charitable organisations, 
some of which manage local facilities as well as maintain 
and develop activity opportunities in the local area. Each 
Local Delivery Partner will deliver the intervention in 
one of the seven regions. It was necessary to have differ- 
ent Local Delivery Partners for each area due to the 
large number of villages receiving the intervention in 
each period, and because the villages are spread across 
the whole county. No one Local Delivery Partner is of 
sufficient size to cover the whole county. Each Local De- 
livery Partner is given strategic support from Active 
Devon as well as a clear framework and timescales 
around the delivery of the intervention with strong focus 
on generating a local needs led approach to designing 
the activities. 

Each village will receive a 'community engagement 
phase' for twelve weeks prior to the intervention 
(Figure 2). During this phase, Local Delivery Partners 
will engage with the local people, elected member 
structures, schools and other community groups to 
carry out a local needs assessment, an assessment of the 



activities currently on offer, and the activities' take-up 
and capacity. This will often include, but not limited to, 
people being directly surveyed to find out what 
activities they would like the Devon Active Villages 
programme to provide. 

The programme will then deliver twelve weeks of 
physical activity sessions, with each village receiving at 
least three different types of activities. These activity ses- 
sions will be subsidised using programme funds. Local 
Delivery Partners will coordinate delivery of the inter- 
vention by finding suitable activity venues, purchasing 
necessary equipment and hiring local experts to deliver 
the activities. Community volunteers will also be 
recruited to help run the activities and will be provided 
with mentoring support throughout the programme. 
Local Delivery Partners will advertise the Devon Active 
Villages activity sessions using local media (e.g., newspa- 
pers, posters, leaflets, village newsletters). 

Each village will also be supported for twelve months 
following the intervention, when Local Delivery Partners 
will help the communities to sustain the intervention ac- 
tivities, by providing specialist support, regular mentor- 
ing for the volunteers and additional funding or 
equipment if necessary. Additionally, local people will be 
offered coaching qualifications to help the villages con- 
tinue the activities independently. 

Outcome measurement 

The primary analysis will compare the proportion of 
adults meeting recommended guidelines for the mini- 
mum level of physical activity (i.e., 150 minutes of mod- 
erate intensity physical activity per week or 75 minutes 
of vigorous intensity physical activity per week) between 
the intervention and control modes. Secondary out- 
comes will be social support, physical activity intentions, 
awareness and use of local facilities, perceived village 
supportiveness of physical activity, and awareness and 
participation in the Devon Active Villages intervention. 

Data collection 

Postal questionnaires and participant information sheets 
will be sent out to participants at baseline (in the month 
prior to the first intervention period commencing) and 
within a week of each of the four intervention periods 
ending (Figure 2). The participant information sheet 
makes clear the voluntary nature of the study and there- 
fore informed consent to participate in the study will be 
implied when participants return a completed question- 
naire. If the number of completed questionnaires 
returned within three weeks of the initial mailing is in- 
sufficient, additional questionnaires will be sent out to 
new households. Participants will receive the question- 
naire, a participant information sheet and a prepaid re- 
turn envelope. It is possible that some individuals may 
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Cluster 1 (22 villages) 
Cluster 2 (36 villages) 
Cluster 3 (35 villages) 
Cluster 4 (35 villages) 




Data collection stages 



j | Control period 

I I Community engagement phase (12 weeks) 

Intervention period ( 1 2 weeks) 

| Follow-up period (1 2 months) 

I Post-intervention period 
Figure 2 Data collection timeline for the Devon Active Villages Evaluation study. 



receive the questionnaire on two or more occasions. In 
such cases, if returned, demographic variables (gender, 
age, height, weight) will be used to identify this wherever 
possible. These participants will remain in the analysis, 
but it will be recorded that each participant has com- 
pleted the questionnaire on more than one occasion. 

Measures 

Demographic characteristics 

The survey will include questions on gender, age, height, 
weight, health, occupation, car ownership, children in 
the household, and dog ownership, based on ques- 
tions from national surveys from different populations 
(e.g., Burton et al., [25], Craig et al, [5]). 

Physical activity 

Physical activity will be measured using the short version 
of the International Physical Activity Questionnaire 
(IPAQ) [26]. The IPAQ short- form consists of questions 
on the number of days and time spent on physical activ- 
ity at moderate and vigorous intensity, as well as time 
spent walking and sitting. The mean values for each ac- 
tivity category will be calculated and expressed as meta- 
bolic equivalent (MET) minutes per week, and 
combined to categorise people into low', 'moderate' or 
'high' activity classifications. The self-administered short- 
form IPAQ has been found to have acceptable levels of 
validity and reliability [26] . 

Local area 

To assess perceived characteristics of the local environ- 
ment a scale will be used that was initially developed for 
use in another United Kingdom health study. Partici- 
pants are asked to rate their agreement with 12 items on 
factors such as aesthetics, green space, access to 



amenities, traffic, safety and convenience of routes. The 
scale has been found to have acceptable levels of test- 
retest reliability [27]. Questions on perceived proximity 
and use of different recreational facilities are also 
included. These items were previously found to have ac- 
ceptable test-retest reliability [28]. 

Physical activity campaigns/programmes 

The survey will contain questions on participants' aware- 
ness of and participation in local physical activity cam- 
paigns. The survey will also ask about awareness of 
Devon Active Villages, participation in programme 
events, and opinions on the programme. 

Psychosocial correlates 

Participants will be asked about their intentions to be 
more active in the future. The survey will also ask them 
to rate the importance they place on physical activity on 
a scale from 0 (not at all) to 10 (very), as well as their 
physical activity confidence and the extent to which they 
are trying to do more activity [29]. Finally, a series of 
eight questions will ask participants to rate their agree- 
ment with statements about their physical activity habits, 
social norms, and perceived village supportiveness of ac- 
tivity. These questions were initially developed for use in 
an Australian cohort study (n = 2,485) [25]. 

Sample size 

To detect an increase from 25% to 30% in the percent- 
age of people who meet guidelines for recommended 
physical activity levels, 10 participants need to be 
recruited from each of the 128 villages at each study 
period to achieve 80% power at the 5% significance level 
[30]. A recent pilot for a population study of travel be- 
haviour in the United Kingdom achieved a response rate 
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of 20% for a short questionnaire postal survey [31]. On 
this basis, 50 surveys will be sent out to each village at 
each stage, anticipating that we will obtain at least 10 
responses per village per stage (20% response rate). This 
means that 6,400 surveys will be sent out at every stage 
with the expectation that at least 1,280 will be com- 
pleted and returned. If this response rate is not achieved 
within three weeks of the surveys being posted, an add- 
itional five surveys will be sent out to extra households 
for every one survey missing (20% response rate). 

Statistical analysis 

For any given outcome, data collected across all five per- 
iods will be used in a single analysis comparing the 
intervention and control modes. Analyses will use the 
intention-to-treat principle, with participants analysed 
according to the mode their village (cluster) was in for 
the stage at which they provided outcome data. Random 
effects ("multilevel") linear regression models estimated 
using maximum likelihood [32] will be fitted to compare 
quantitative outcomes between the intervention and 
control modes, specifying the village effect as random; 
marginal logistic regression models using Generalised 
Estimating Equations (GEE) with information sandwich 
("robust") estimates of standard error specifying an ex- 
changeable correlation structure [33] will be fitted to 
compare binary outcomes. Both the random effects 
model and GEE methods allow for correlation of out- 
comes within the same village cluster. Under both meth- 
ods, a binary predictor variable will be used to indicate 
intervention versus control status and period of study, 
gender and age will be adjusted for. All analyses will be 
carried out using Stata software (StataCorp. 2011. Stata 
Statistical Software: Release 12. College Station, TX: Sta- 
taCorp LP). 

Ethical consideration 

The study received ethical approval from the Sport and 
Health Sciences Ethics Committee at the University of 
Exeter (February 2011). 

Discussion 

This paper has outlined the Devon Active Villages Evalu- 
ation study design and data collection, as well as details 
on the implementation of the intervention. The DAVE 
study is the first to use a stepped wedge cluster rando- 
mised controlled trial design to evaluate the effectiveness 
of a community-level intervention designed to increase 
physical activity. The stepped wedge design is advanta- 
geous in studies where the intervention cannot be with- 
held from a proportion of the population and cannot be 
delivered to all intervention clusters at the same time. 
This study will demonstrate that it is possible to evaluate 



physical activity interventions using a stepped wedge 
trial design. 

Strengths of the study will include the number of par- 
ticipating villages and the multiple data collection stages. 
The main limitation of the study is the self-reported out- 
come measure of physical activity that may lead to some 
misclassification. The implementation of the Devon Ac- 
tive Villages intervention may increase physical activity 
participation in rural villages in southwest England. The 
results from the study will contribute to the limited re- 
search available on physical activity in rural communi- 
ties in England and other developed countries. This 
pragmatic evaluation of a community-led intervention 
is expected to provide a model of how to evaluate 
physical activity promotion in the community when it 
is being delivered by local organisations that fre- 
quently deliver such interventions with no evaluation 
at all. The study should help demonstrate how inde- 
pendent researchers and practitioners can successfully 
work together to evaluate natural experiments in real 
life settings. 

In conclusion, the Devon Active Villages Evaluation 
study is believed to fill gaps in the current literature, 
providing new insights into rural physical activity, using 
innovative study designs to evaluate the intervention, 
and developing collaborations between researchers and 
practitioners to evaluate natural experiments. Therefore, 
the results from this study will contribute to the body of 
evidence on stepped wedge cluster randomised trials 
and community-level interventions, and may be useful 
for researchers and practitioners for future evaluations 
of complex public health interventions. In addition, if 
the Devon Active Villages intervention proves successful 
in improving population physical activity prevalence the 
intervention could be disseminated at national and inter- 
national level. 
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